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Abstract 



We consider a singular stochastic control problem, which is called the Monotone Follower Stochastic Control 
Problem and give sufficient conditions for the existence and uniqueness of a local-time type optimal control. To 
establish this result we use a methodology that has not been employed to solve singular control problems. We 
first confine ourselves to local time strategies. Then we apply a transformation to the total reward accrued by 
reflecting the diffusion at a given boundary and show that it is linear in its continuation region. Now, the problem 
of finding the optimal boundary becomes a non-linear optimization problem: The slope of the linear function and 
an obstacle function need to be simultaneously maximized. The necessary conditions of optimality come from 
first order derivative conditions. We show that under some weak assumptions these conditions become sufficient. 
We also show that the local time strategies are optimal in the class of all monotone increasing controls. 

As a byproduct of our analysis, we give sufficient conditions for the value function to be C 2 on all its domain. 
We solve two dividend payment problems to show that our sufficient conditions are satisfied by the examples 
considered in the mainstream literature. We show that our assumptions are satisfied not only when capital of a 
company is modeled by a Brownian motion with drift but also when we change the modeling assumptions and 
use a square root process to model the capital. 



1 Introduction 

We solve a class of singular control problems which are known as Monotone Follower Stochastic Control Problems 
(see Karatzas and Shreve J7) for the terminology) for a general class of diffusion processes. In particular, we give 
necessary and sufficient conditions under which the continuation region is constituted by a single open interval 
in the state space of the controlled process. To establish our main result, we first restrict ourselves to local-time 
strategies, each of which corresponds controlling the underlying diffusion by reflecting it at a particular point. 
Applying a particular transformation to the total reward accrued by reflecting the diffusion at a given boundary, 
we show that the transformed reward is linear in its continuation region. The slope is a function of the boundary 
point. In the rest of the state space, in the region of action, the transformed reward is equal to an obstacle, 
which also depends on the value of the boundary point. This transforms finding the optimal boundary to a non- 
linear optimization problem: The slope and the obstacle have to be maximized simultaneously. We give the 
necessary conditions of optimality using the first order derivative conditions and show that under some weak 
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assumptions these conditions become sufficient. That is, our methodology of identifying the unique solution of the 
singular control problem relies on a combination of the classical diffusion theory, which helps us give a geometric 
characterization of the value function (the optimal reward), and non-linear programming. Next, we show that the 
local time strategies are optimal in the class of monotone increasing strategies under some certain assumptions. 

Among the benefits of our analysis are the sufficient conditions we provide for the value function to be C 2 
in the entire state space. This sheds light on the heuristic principle of smooth fit, which suggests that the value 
function is C 2 across the boundary that demarcates the regions of action and inaction. Our approach should be 
contrasted with the ad hoc ordinary Hamilton-Jacobi-Bellman (HJB) approach, which assumes the principle of 
smooth fit to construct a solution. There is no guarantee that a solution could be found and using that method it is 
hard to establish sufficient conditions under which a solution exists. And even if a solution is constructed to the 
quasi-variational inequalities, one still has to verify whether the solution satisfies the assumptions of a verification 
lemma, i.e., verify the optimality. For further details of this approach see e.g. 0ksendal and Sulem [9 1. 

To illustrate our results we consider the dividend payment problem for two different scenarios. First, we take the 
cash-flow of a company to be a Brownian motion with drift. (This case was analyzed by Jeanblanc and Shiryaev 
[6 1 using the ordinary HJB approach.) Second, we take the cash flow of the company to be a square root process. 
In this case we show that the optimal reflection level is strictly less than the mean-reversion level. In the second 
example the functions in terms of which the sufficient conditions are stated are only available in terms some special 
functions. Yet, we are able to prove that the sufficient conditions in our theorems are satisfied by only analyzing the 
ordinary differential equation these functions satisfy without making a reference to their explicit representations. 
This gives us a method to check the sufficient conditions for other diffusions even when explicit representations are 
not available. We also extend our results to solve constrained optimization problems. A dividend payout problem 
with solvency constraints was recently solved by Paulsen ifTOl . In this problem, the firm is allowed to pay dividends 
only if the cash flow process is greater than certain (pre-determined) value. Here, we provide a simpler proof to 
Paulsen's result, by a very simple modification of the proof of Proposition 2.3, which characterization provided for 
the optimal reflection barrier. 

A similar methodology to ours was used by Dayanik and Karatzas [3|, to give a general characterization of 
the value function of the optimal stopping problem of one dimensional diffusions. The value function of the 
optimal stopping problem (up to a transformation) is characterized as a concave majorant of a fixed obstacle. In 
the singular control problem we analyze, the obstacle is not fixed. When we apply the same transformation to the 
reward corresponding to the control that is identified by a fixed boundary, the transformed reward becomes linear 
in the region of inaction whose slope depends on this boundary point. On the region of action the transformed 
reward is an obstacle and is a function of the boundary point. Therefore, we maximize the slope of the linear 
function and the obstacle simultaneously over all possible boundary points to obtain the optimal boundary. As a 
result, we characterize the optimal boundary first and compute the value function (the optimal reward) given this 
characterization, whereas [ 3 1 characterize the value function first and then compute the optimal boundary using 
this characterization. 

Dayanik and Egami [4], Bayraktar and Egami [l] (in this work effects of implementation delay are taken into 
account) also use similar methodologies. However, the results we obtained here can not be obtained from the results 
of these papers. In these papers, we could not characterize the optimal control policy completely. The boundary 
of the region of action and inaction can be completely characterized only when the threshold that the state process 
is taken to, after the application of the control, is given. Therefore, the characterization of the optimal boundary 
that we obtain here for the singular control problem can not be obtained using a limiting argument (as the fixed 
cost goes to zero). Also, the two problems are very different in nature. For example, the singular control problem 
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is smoother than the impulse control problem. In the impulse control problem, given a particular policy, both the 
slope of the transformed reward in the region of inaction and the obstacle (the transformed value function in the 
region of action) can be determined using the fact that it is continuous at the boundary. However, determining 
the slope of the transformed reward in the singular control problem is trickier. To write down the slope of the 
transformed reward in the region of inaction as a function of the boundary, we first show that the transformed 
reward is C 1 . The continuity of the first derivative is also used to determine the obstacle (the transformed reward 
in the region of action) as a function of the boundary point. On the other hand, the proof of optimality of local time 
strategies among a more general class of controls in the case of singular control problem differs significantly from 
the optimality proof of the threshold strategies in the case of impulse control problem. The latter uses the fact that 
the value function (optimal reward) of the impulse control problem can be approximated by a sequence of optimal 
stopping problems. 

The rest of the paper is organized as follows: In section 2, we solve the monotone follower problem for a general 
diffusion. We first find the optimal local time strategy. In Section 2.1, we state the problem, in Section 2.2, we 
characterize the value function corresponding to a given boundary and after applying a particular transformation 
value function becomes linear in the region of inaction. In Section 2.3, we characterize the optimal local time 
control. We also extend our analysis to solve a constrained optimization problem. In Section 2.4, we show that the 
local time strategies are optimal among all admissible monotone controls. Here, we also point out that under the 
assumptions of Proposition 12.11 the value function is C 2 . In Section 2.5, we solve the dividend payment problem 
when the capital of a company is assumed to be either Brownian motion with drift or a square root process. We 
collect some preliminary results to Section 3, which is our appendix. 



2 Solution of Monotone Follower Problems 

2.1 Reflected Diffusions 

Let (f2, T 1 {Tt)t>0i P) be a complete probability space with a standard Brownian motion W = {Wt',t > 0} and 
consider the diffusion process X° with state pace X = [c, d) C K and dynamics 

dX° = (i(X^)dt + a{X?)dW t (2.1) 

for some Borel functions // : I — > K and a : I — » (0, oo). (We assume that the functions \i and a are sufficiently 
regular so that d2.ll ) makes sense.) We use "0" as the superscript to indicate that X° is uncontrolled. We denote the 
infinitesimal generator of X° by A and consider the ODE [A — a)v(x) = 0. This equation has two fundamental 
solutions, ?/>(•) and ip(-). We set ip(-) to be the increasing and ip(-) to be the decreasing solution. Q We will take c 
to be absorbing and d to be natural, and therefore ip(d-) = oo, ip(d— ) = since X° never reaches d. First, we 
define an increasing function 

f(x) 4 44- < 2 - 3 ) 



'In fact, denning = in{{t > : = r}, for every r € (c, d), we can write 



e v , ifx<y l/E» e -aT «> , if x < y, 

#0 = 4 , L r on " . r a ,oi 1 ~ - (2.2) 

1/E» e- QT * , if x > y I E x 6 y I if x > y 



for every i£l and an arbitrary but fixed y 6 X (see Ito and McKean ['5']). 
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Next, we define concavity of a function with respect F as follows: A real valued function u is called F-concave 
on (c, d) if, for every c < I < r < d and x £ [I, r], 

U{X) * U{1) F(r) - F(l) + u{r) F(r)-F(l)- 
Consider the solution of (X, Z) of the stochastic differential equation with reflection 

dX t = n(X t )dt + a(X t )dW t - dZ u I -^e(c,(i), (2.4) 
where Z = (Zt)t>o is a continuous non-decreasing (except at t = 0) {jFt}-adapted process such that 

Z t — Z = / l {Xs =b}dZ s , (2.5) 

for some 6 £ (c, c?). Here, we use the same notation as (6), see equations (4.7) and (4.8). To emphasize the fact 
that the initial value of the process Z, Zq, depends on Xq_ = x, below we denote it by Zq{x). We assume that 
x — ► Zq(x), x £ (c, d), is a measurable function and Zq(c) = 0. 

Here, Z is called the /oca/ time of the process X at point b. When this control is applied to the state process 
{X t }t>o, for t > 0, it moves in (c, 6] and it is reflected at b (until the time of absorption). First, we will find the 
best local time strategy. We will denote the set of local time strategies by 21. Next, in Proposition 12. 31 we will 
show that under some certain assumptions the local time strategies are optimal in a larger class of controls, namely 
non-decreasing, {jF t }-adapted controls. Let r c = inf{i > : X t — c}. We consider the following performance 
measure associated with Z £ 21 



J z {x) = h- Z Q (x) +E x - Zo ^ 



e- as f(X s )ds + h I 

ii J(0,r e ) 



(2.6) 



for some given h £ M+. Here, F X - Z °W{-} is a short-hand notation for the conditional probability measure 
P{-|Xo = x — Zq(x)} and W^ 20 ^ is the expectation with respect to that probability measure. In ( 12.61 , we used 
the following notation 

r r Tc 

s dZ s — hZo(x). 



h I e 

'(0,T ) 



s dZ x = h I < 
lo 



(2.7) 



The objective is to find the optimal strategy Z* £ 21 (if it exists) and the value function: 

v{x) = sup J z {x) = J z '{x). 

One could choose 21 to be the family of non-decreasing, {Tt }t>o _a dapted process. We will show in Proposition ^. 3 
that it is enough to consider only the local time strategies under certain assumptions. 



Assumption 2.1. The function / : (c, d) 



I 



is continuous and satisfies 

-<* s \f(X° s )\ds] <oo. 



(2.8) 



2.2 Characterization of the Value Function Corresponding to a Given Reflection Level 



We will first obtain a dynamic programming equation for the performance measure (12. 6t . Next, we will apply 
a transformation to linearize the difference between the value associated with a particular control and the value 
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associated with not applying any control at all. Recall that the region in which the particular control prescribes no 
action is commonly referred to as the continuation region or inaction region of this particular control. 

Let n = {t > : X t > b}. On denoting 



-as £ ( v"0 



f(X° s )d S 



for x <G [c, b], we can write 





= E X 



e~ as f(X s )ds 



= w 


[/' 




../() 


f(X° s )d 


s + 



e- as f(X s )ds 
e- as f(X°)ds + e -«KAT c ) E x Tb Ar c / " e -°»f(x,)di 



■.g{x)-W\e-^^g{X°)]+W 



9(x)-E x [e-^ A ^9(X iTbATc) _)}+E x 



in which the third line follows from Lemma IXT1 in the Appendix. Therefore, for x E (c, b] 



J z (x) = E a 



Let us define 



-a(Ti,AT c ) 



-g(X {TbATc) _)+E x ^ 

-a(r b AT c ) (_ 5 (X (7lAre) _) + J Z (X TbAr J} 



e- as f(X s )ds + 
+ g(x). 



s hdZ< 



(0,T C 



■ b (x)± J z {x)-g{x), xe[c,d). 



It is worth noting that u b (c) — —g(c) since J z (c) = 0. 
Equation (12. 10b can be written as 

u\x) = E x [e- a ^ A ^{u b (X TbAT J - g(X {TbATc) _) +g(X TbATc )} 
'e- a ^ AT ^u b (X TbATc ) 



: E X 



for x € (c, b]. On the other hand, if a: € [6, d), then 



b {x) =h-(x-b)- g(x) + g(b) + u b (b), x <e [6, d). 



Using ( |2.12t and ( |2.13t can be written in a more compact form as 



u b {x) 



u b {x) 4 E x [l {rb<Tc} e-^ W b (6) + l {Tb>Tc} e-* - 1 
K{x,b)+u b {b), 



u"(c)] , x € [c, 6], 



x e [6, d), 



in which 



K(x, y) = h- (x-y)- g{x) + g{y). 

Observe that u b (x) is continuous at x = b. 

Using Lemma [3721 we can write the function x — > Uq(x), a; € (c, 6] as 

b b <ip(c)<p(x) - i/}{x)tp(c) , b ,^i>(x)(p(b)-il}(b)ip(x) 

u o\ x ) — u \°)~ 



ip(c)f(b) - tl>(b)tp(c) 



■u»(c) 



i>(c)<p(b) - ip(b)ip(c) 



(2.9) 



(2.10) 
(2.11) 



(2.12) 



(2.13) 



(2.14) 



(2.15) 



(2.16) 



The function x — > Uq(x), a; € (c, 6] can be linearized by using 

W*{x)±{ul/v)oF-\x), xe[F(c),F(b)}, (2.17) 

and ( 12.161 becomes 

W*(x) = W^Fic)) /^-^ +WS(F(b)) / { -^ ) {cy xe[F(c),F(b)]. (2.18) 

We extend the function x — > Wq (x), from x € [-F(c), to [F(c), by defining 

W b {x) = (u b /ip) oF -1 (ic), xe[F(c),F(d)). (2.19) 

We have now established that W b (x) is a linear function in the transformed continuation region (the region of 
no action). Note that J2.141 i and J2.18t do not completely determine u b : the slope and the intercept of the line 
W b (x) x G [F(c), F(b)] need to be determined. But we already know that 

the linear function W n b (-) passes through (F(c),l c ) = ( F(c), ^-^) . (2.20) 

The slope of this linear function will be determined as a function of b, i.e., b — > (3(b), b 6 (c, d). Then, we will give 
sufficient conditions in Proposition ^, ll under which the optimal b*, i.e. 6 G (c, d) such that u b (x) — v(x) — g{x), 
can be determined by the ordinary first order condition, i.e. as the unique solution of d(3(b) /db = 0. 

2.3 Characterization of the Optimal Reflection Level 

In this section, we characterize the optimal level at which the diffusion is to be reflected to maximize a given 
reward functional as the unique solution of a non-linear equation. We first transform the function K(-), defined in 
d215l into 

R(x;b)± K{ f~^\ xe[F(b),F(d)). (2.21) 
ip{F L {x)) 

From d27T8T > and ( T2T20T > it follows that 

W b (x) = 0(x - F(c)) + l c , i£ [F(c), F(6)], (2.22) 

for some j3 G M, which is to be determined as a function of &. Our task in this section is to identify an appropriate 
slope (3* — f3(b*), so that the function b — > W (a;) is maximized at &* for any x € (c, d). 

Proposition 2.1. Lef us define k : E — > K by 

fc(x) 4ft- g '(a;) - Z c¥ >' (x). (2.23) 

AiiMme f/jaf: (i)For any b G [c, e?), R(y;b) defined in H2.2H is differentiable with respect to y; (ii)For any 
b 6 [c, rf), x — > i?(x; 6) + y ^-i/ x )) ^(F(fe)) is increasing and concave on x G (F(J), F(d)) for some point 
j G (c. d) and it approaches infinity as x — » d; (hi J There exists a unique solution b* G (c, (f) fo f/ie equation 

k'(b)ip'(b) - k(b)ip"(b) + F(c)[k(b)(p"(b) - k'(b)ip'(b)] = (2.24) 

such that b* satisfies 

fc"(b*)V'(6*) - k(b*)ip'"(b*) + F(c)[-k"{b)cp'(b) + fc(%" 0)) < 0. (2.25) 
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Then the solution of ( 12. 71 ) is given by v(x) = u b (x) + g(x), in which u b is given by the equation (\2.14j if we 
replace b by b* and choose the slope of H2.18\) to be (3* , which is given by 

a* A jKjj ) 0£\ 

*■ ~ ^{b*)-F{c)<p'{b*y y ■ ' 

Recall that W b * (x) is linear for x £ [F(c), F(b*)). 

Proof. We will first determine the slope of the line in d2.22b , as a function of b, i.e., b — > (3(b), b S [c, c?). This 
will be established by showing that W defined in (12. 1 9b is continuously differentiable at b. To this end we will 
first consider the threshold strategy that is characterized by the pair (b, a) G [c, d) 2 : Z is said to be a threshold 
strategy corresponding to (b, a) if, whenever the process X in ( 12.41 ) hits level a or is above a, then it jumps to (the 
jump is forced by Z) level b < a. (Although, the letter Z was used to denote only local time strategies before we 
would like to use it to denote the threshold strategies to be able to refer ( 12.4b when we are describing threshold 
strategies. This prevents introducing unnecessary equations.) Consider the reward in ( 12.6b corresponding to the 
particular threshold strategy Z and denote it by u b > a . Note that u b ' b = u b . The control represented by the pair 
(b, a) is of impulse control type. For b <E [c, d), let us find a(b) such that sup ag [ c d ) u b ' a — u b ' a ^ b \ Using the 
results in Section 2.2 of [1 1 and the assumption (i) and (ii) of the proposition we conclude that, for any 6, there 
exists a unique a(b) such that the function x — > W b ' a ( b '(x), defined by ( 12. 1 9b when u is replaced by 
continuously differentiable at a(b). This characterization of the function b — > a(b), b e [c, d) will be used to show 
a(b) = b,b 6 [c, d) and to calculate the slope b — > (3(b), b E [c, d). 

Let us define 

WHx) 4 { ~ F[C)) +lc ^ [F{c) ' F{b)] (2 27) 

\ H (x,b)±R(x;b) + ^0^((3(b)(F(b)-F(c))+lc), jr(d)). 



in which 

m = m 

' v ' ^'(b) - F(c)tp'(b) 
The right-hand derivative of the function W b satisfies 

(W b )'(F(b)+) = -(j3(b)(F(b) ~ F(c)) + lc)^J7^ + ^.R{x; b) 



(2.28) 



x=F(b) 

1 , ip ( x )(-g'(x) + h)-(h-(x-b)-g(x)+g(bW(x) 1 



a; — b 



= -09(6)(F(6)-F(c))+/ c )- : 

(p[b) ±<'(b) ip(x) z t'(x) 

= /?(&), 

(2.29) 

where we used (12.15b and (12.21b to derive the first equality, and (12.28b to derive the third inequality. The function 
x — > W b (x), x £ [F(c], F(d)) is C 1 at x — F(b), since the left-hand derivative is also (3(b). This implies that 
W b = W b > a{ V or (u b ^ip) o F- 1 = W b and that a(b) = b. As a result we see that V^ b satisfies smooth fit 
condition at b and the slope in ( 12.22b is given by ( 12.28b . Before we continue with the proof the reader should note 
that 



<4& F( a ) _ 4^F(&) + F(c) f-1 + 4^"l aib F '( a M a ) + ^( a V («) - ^(c)^'(a) 

h - g'(b) - l c <p'(b) = k{b) 

F'(b)cp(b) + F(b)tp'(b) - F{c)ip'{b) tP'(b) - F(c)ip'(b) ' 
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where the second equality follows from an application of L'Hospital's rule. In contrast with equation (2.25) in JT], 
this implies that the first order smooth fit of the singular control at b can be derived by a limiting argument from the 
continuous fit of a family of impulse control problems at b. Here, the first order smooth fit holds at any b £ (c, d), 
not only at b* , which we will soon discover to be the optimal reflection barrier. 

Equations ( 12.24) and ( 12.251 ) imply that (3'(b*) = and /?"(&*) < 0. Therefore, b* is a local maximum of the 
function b — > (3(b). On the other hand, since we assumed that the uniqueness of the solution to (12.24) . b* is the 
unique local extremum of the function b — > (3(b). Let us argue that b* is the global maximum of this function: 
Assume there exists a point m ^ b* where the maximum of the function b — > /3(b) is attained. Then there would 
exist local minimum n G (m, b*) of the function b — » (3(b) which contradicts the fact that b* is the unique local 
extremum of this function. Note that b — ► (3(b) = k(b)/ip'(b) may not be concave. 

Recall the definition of the function H from ( 12.27) . Using ( 12.15) and ( 12.21) we can calculate the derivative of 
H with respect to b as 



d_ 

db 



H(x; b) 



-h + g'(b) + V '(b)((3(b)(F(b) - F(c)) + Q + (f3'(b)(F(b) - F(c)) + (3(b)F' \b))<p(b) 



b=b' 



p(F-i(x)) 

-h + g'(b) + (3(bW(b) + W(b) + (3'(b)F(b) V (b) - F(c)((3(bW(b) + (3'(b)ip(b)) 



b=b' 



v(F~ l (x)) 



b=b" 



(3>(b)(F(b)-F(c)Mb) 



V(F- X (x)) 



= 0. 



b=b* 



(2.30) 



Here, the second equality follows from the definition of F in (12.3) , and the third equality follows from the definition 
of (3(b) in (IZ281 and (l2~23l . Note that, 



On the other hand, 

d 2 



db 2 



H(x;b) 



■ \ 

—H(x;b) = if and only if b = b* . 
db 



(3"(b)(F(b) - F(c)Mb) + (3'(b)F'(bMb) + (3'(b)(F(b) - F(cW(b) 



(2.31) 



<0, (2.32) 



6=6- V(F-Hx)) 6=6 , 

since (3'(b*) = 0, (3"(b*) < and F is increasing. Now, ( T2~27] |, (|2~30) . (ED) and (l2~32l , together with the fact 
that 6 — > (3(b) is maximized at 6* imply that 



W b *(x)= sup VK b (a;), x € [F(c), F(d)). 

be{c,d) 



(2.33) 



The proof of our assertion follows since it is immediate from (12.33) that u b (x) — sup be j c d ^ u b (x), for all x € 
[c,d). □ 



We can extend our results to solve constrained optimization problems. A dividend payout problem with solvency 
constraints was recently solved by Paulsen iflOl . In this problem, the firm is allowed to pay dividends only if the 
cash flow process X is greater than certain (pre-determined) value b. Here, we provide a simpler proof to this 
result, using the characterization we provided for the optimal reflection barrier in Proposition 12. II 

Corollary 2.2. Assume that the assumptions of Proposition\2J\hold. Let 21 be the set of Z £ 2t such that 

Z t ~Z = [ l {Xs=b} dZ s , b<be(c, d), (2.34) 
J(o,t) 
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for a fixed b and define 



b^ 



• ,b* if b*<b, 



b if b* > b. 
Let us also define Z by replacing b with b in H2.34[ . Then 

v{x) = sup J z {x) = J 2 (x). 

Proof. The proof follows since under the assumptions of Proposition 12.11 the functions b 
b — > H (x; b), x S [c, d) have a unique maximum at b*. (See the proof of Proposition |2J}. 



(2.35) 



(2.36) 



P(b), b e [c,d), 
□ 



2.4 The Optimality of Local Time Strategies in the Class of Monotone Increasing Con- 
trols 



v{x) 



(2.37) 



Let us write the value function v(x), explicitly and make some observations on it. 

v (x)±<p(x)([3*(F(x)-F(c))+l c )+g(x), xe [c,b% 
h-(x-b*)+v (b*), xe[b*,d) 

where the second equation is obtained by 

K(x, b*) + u b J (&*) + g(x) =h-(x-b*)- g(x) + g{b*) + <p{b*){[3*{F{b*) - F(c)) + Q + g(x) 

= h-(x-b*)+v (b*). 

It is worth noting that v(c) = 0. 

Remark 2.1. (a) The first and the second derivative of v(x) on (c, b*) are 

v '(x) = py/(x) + (l c - (3*F(c))tp'(x) + g'(x) and v"(x) = j3*ip"(x) + (l c - 0*F(c))(p"(x) + g"(x) 

Evaluating these expressions at b* we obtain 

k(b*) 



v'(x) 
v"{x) 



__ b , 4>>(b*)-F(cW(b*) 
k(b*) 



(t/j'(x)-F(e)<p'(x)) + h-k(x) 
(ip"(x)-F(c)ip"(x))-k'(x) 



= h, 



0. 



(2.38) 



=6 , ^{b*) - F{c) V '{b*) 

We used ( I2.231 l and ( 12.26b to obtain the first expression and ( 12.241 ) to obtain the second expression. Note 
that these smooth fit conditions are the two boundary conditions that are frequently imposed to solve the 
singular control problems in an ordinary Hamilton-Jacobi-Bellman (HJB) approach. In that approach, after 
the solution is constructed, the assumptions are verified using a verification lemma. However, the smooth fit 
conditions need not necessarily hold and the HJB approach is unable to tell the sufficient conditions for the 
smooth fit to hold. Using our alternative methodology, in Proposition ^. II we are able to list some sufficient 
conditions for the value function to be C 2 on all of its domain. 



Furthermore, 



(A- a)v(x) = (A- a)g(x) = -f(x) for x € (c, b* 



(2.39) 



(b) Under assumption (hi) of Propostion 12. li the function b — > k (b) /(ip' (b) — F(c)<p'(b)) is maximized at b*. 
Therefore, using the first equation in ( 12.38b it can be checked that v'(x) > h, x G (c, d). 
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(c) Since 6* satisfies (12.241 1. then we have that 

k(b*) _ k'(b* 



i>'{b*) - F{c)<p'{b*) ip"(b*) - F{c)tp"(b*) ' 
Now using, the second equation in ( I2.38l l we have that 



(2.40) 



v " {x) = r¥Y^m^W) {r{x) " F{cW ' {x)) ~ k ' {x) > x e (c ' 51 (Z41) 



If either 



k'(x) 

(p"(x)—F(c)(p"(x)>0, x G (c, 6*1 and x — > — — — — is a decreasing function on (c, 6*1 

ip"[x) — F(c)ip"{x) 

(2.42) 

or 

k'(x) 

ip"(x)—F(c)(p"(x)<0, x <E (c, 6*1 and x — > — ' — — — is an increasing function on (c, 6* 

(2.43) 

then i/'O) < 0, x G (c, 6*]. Note from d2"37i > that v"(x) = on a; G [b*,d). 
(d) Forx G \b*,d) 

(A - a)v(x) = {A- a)(h ■ (x - 6*) + v (b*)) = fi{x)h - ah ■ (x - 6*) - av (b*), 

< p{x)h — avo(b*) < fx(b*)h — avo(b*) — lim (A — a)v{x) n 

= Yaa{A-a)v{x) = - lim f(x) = -f(b*) < -f(x) 

xlb* x]b* 

if we assume that the maximums of the functions x — > fi(x) and x — > /(x) on the interval [6* , c?) are attained 
at 6* (for e.g. if both x — > /(a;) and x — ► /i(x) are non-increasing on [6*, d)), and that these functions are 
both continuous at 6*. Note that the identity lim^xh* (A — a)v(x) — \im x ^b* (A — a)v(x) is due to ( 12.38b . 

The following proposition gives sufficient conditions under which the local time strategies are optimal in the 
class of all increasing strategies. 

Proposition 2.3. Assume that the assumptions of Proposition \2~l\ hold. Consider the process 

dX t = fi(X t )dt + a(X t )dW t - d£ t 

in which £ t is an {J- 1\ -adapted, non-decreasing and right-continuous process {except possibly at zero) such that 
[L 00 e~ as d£ s ] < oo. We denote the family of such controls by C. Let us assume that x — > a(x), x G (c, d) is 
a bounded function, the maximums of the functions x — > p(x), x — > f(x) on x G [6*, d) is attained st b*, and that 
both /i(-) and /(•) are continuous at 6*. We further assume that either H2.42[ or H2.43\) holds. Then x — > v{x), 
x G (c, d) defined in (\2.37i satisfies v(x) > J* (x), x G (c, d), /or any £ G C, in which 



(2.45) 



Proof. We first apply Ito's formula to e Qt w(X t ) and get 

e~ at v(X t )=v(x)+ [ e~ as (A- a)v{X s )ds- [ e~ as v' (X s ^ s + [ e - as a(X s )v' \X s )dW s 
Jo Jo Jo 



e- a3 (v(X s )-v(X s -)+v'{X s -)AX s 



(2.46) 



0<s<t 
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in which AX S = X s - — X s , s > 0. From equation (12.46b and Remark l2~T1 (b). (c) and (e), it follows that 



v{x)= / he- as d£_ s - / e- as (h-v'{X s -))d£, s - / e~ as {A - a)v(X s )ds 



j a(X s )e- a3 v'(X s )dW s - £ e~ as (v(X s ) - v(X s _) + v'(X s _)AX s ) + e - at v(X t 



> / he~ as d^ + / e- as f{X s )ds- / a(X s )e~ as v'(X s )dW ( 
Jo Jo Jo 

]T e~ as (v(X s )-v(X s _)+v'(X s _)AX s ) + e- at v(X t ) 



(2.47) 



0<s<i 
ft 



> / he- as di s + / e- as f(X s )ds- / a(X s )e- as v'{X s )dW s 
Jo Jo Jo 

- e- as (v(X s )-v(X s _)+v'(X s _)AX s ). 

0<s<t 

The last line follows because v is positive: v(c) — and v'(x) > h > 0, x 6 (c, d), by Remark l2~Tl (b). 
We have that 



E 



e^V(X s K(X s )cW s 



0. 



(2.48) 



since v'(x) and cr(a:) are bounded. On the other hand, since v"(x) < (see Remark l2~Tl (d)) for any x > y 

v(x) — v(y) — v'{x)(x — y) = / (v'(u) — v'{x))du > 0, 

"'a 

which implies that 

- e- as (v(X s )-v(X s _)+v'(X s _)AX s )>0. 

0<s<t 

Now (|233, ( 12481 . d2749b imply that 



(2.49) 



u(x) > E x 



[ h ■ e~ as d4 s + [ e- as f(X s )ds 
Jo Jo 



for all t > 0, which implies that v(x) > J^(x) for all x S (c, d) after taking a limit as < — » oo. The exchange 
of limit and integration is possible due to Assumption 12. 1 1 and the definition of C as a result of an application of 
bounded convergence theorem. □ 

Remark 2.2. We give a useful hint which will be helpful in checking whether 

x — ► R(x: b) + ^(^-1(3;)) W(F(b)), x € (F(c),F(d)) satisfies assumption (ii) of Proposition [XT] Let us denote 



m(x) 



F'(x) \ip 



(2.50) 



then R (y; b) — mix) and R (y; b) = m (x)/F (x), in which y = F(x). If x — > X (a;, 6) is twice-differentiable 
at a: 6 (c, d), then 

i?"(y;b)[(.4- a)if(a;,6)] > 0. (2.51) 

The inequality is strict if R" (y; b) ^ 0. 
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2.5 Examples of Dividend Payment Problems 



Example 2.1. Dividend payout with a Brownian motion with drift (Jeanblanc and Shiryaev |6|, Case C): 

Let us assume that the capital of a company is modeled a Brownian motion with a drift and the managers of the 
company would like to maximize the amount of dividends payed out. We assume that the company is ruined when 
the capital becomes (i.e. an absorbing boundary). The right boundary +oo is natural. The uncontrolled process 
X° is a Brownian motion with drift 

dX? = pdt + adW t . 



The value function is defined as 



e~ at dZ t 
(o,to) 



(2.52) 



where r = inf {t <0;X t = 0}. 



In this problem, f(x) = and h = 1 and K(x,y) = x — y. As in [6 1 we take a = \/2. By solving the 
equation (.4 — a)v(x) = 0, in which A is the infinitesimal generator of the uncontrolled process X°, we find 

if,(x) = e^ +A)x and tp{x) = e^-^" where A = ^(f) 2 + a. Hence F(x) = e 2Ax and F^fx) = 
Note that F(0) = 1, l c = and k(x) = 1. 

Verification of the Conditions in Proposition 12. II 

(i) For a given b > 0, we have that 



R(y;b) = (K/v)(F-\y)) = ] ^-(y 1 



ony> F(Q) = 1. This function is differentiable with respect to y. 

(ii) R(-; b) is increasing on y e [F(0), oo) by ( 12.50b and lim^oo R(y; b) = oo. We also have that 

1 l0g2/ (2.53) 



<p(F-i(y)) 2A 

is increasing on [.F(O), oo) to oo. 

On the other hand, (A — a)K(x,b) = p(x) for every x > 0, in which p(x) = \i — a(x — b). This linear function 
p{x) has only one positive root at say, k. Then by (12. 5U , R(y; b) is convex on y 6 [F(0), F(k)) and concave on 
y € {F(k), oo). Observe from (12.531 that l/(p(F~l(y)) is concave. 

(iii) From (12.241 1. Since k'{x) = for x <E [0, oo), Equations ( 12.241 ) and ( 12.251 ) become 

^"(6) - F{0)<p"{b), (2.54) 
1 p"'(b*)-cp"'(b*)F(0)>0. (2.55) 

Since ip"(-) is increasing and <p"(-) is decreasing on [0, oo), equation ( 12.551 ) holds for all x € [0, oo). Moreover, 
since ip"(0) < <p"(0) and = lim^^oo <p"(x) < lim^^oo ip"(x) — oo, there exists a unique solution to ( 12.541 ). 

Verification of the Conditions in Proposition l2.3t The only non-trivial condition to check is whether v" (x) < 

for x € (0, oo). It can be shown that t/j"(x) — F(0)ip"(x) < on x E (0, 6*), by the same argument that we 
used to prove the uniqueness of the root of ( 12.54b and the concavity of v follows from Remark l2~Tk . Hence we 
conclude that the local time strategy at b* is optimal among all the admissible strategies. 
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Now, vq(-), defined in (12.37b can be computed as 



v(x) = <p(x)W b * (F(x)) = (3*(F(x) - l)<p(x) = (3*(e 



2xA 



1 e 



-(/x/2+A)z 



= /3*e~^ /2 (e A;l; 
The solution to this problem is then 

v(x) = 



-Ax\ 



2(3* e 



-y.x/2 



sinh(a;A). 



v (x), 0<x<b*, 
v (b*) + x-b*, b*<x, 



which coincides with the solution that is computed by Jeanblanc and Shiryaev [6 1 by using the ordinary HJB 
approach, which is specific to the modeling assumptions. Figure [T] shows the value function after applying the 
transformation (I2.19l l, the slope function b — > (3(b), b £ (c, d), the value function and its derivative when the 
parameters are (/x, a) = (0.15, 0.2). The optimal reflection point is b* = 0.736246 and (3(b*) = 1.16523. 




(a) 



V(x) 

1.75) 
1.5 
1.25 
1 

. 75 
0.5 
0.25 
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F(x) 



0.25 0.5 0.75 1 1.25 1.5 1.75 



(c) 




V (x) 



1 . 08 
1.06 
1 . 04 
1 . 02 



(b) 



0.25 0.5 0.75 1 1.25 1.5 1.75 



(d) 



Figure 1: The analysis of the singular control problem of Jeanblanc and Shiryaev |6| with parameters (fi, a) = (0.15, 0.2): 
(a) The function x — > R(F(x),b*) + (p(b*)/<p(x), x £ (c,d) and its linear majorant. (b) The graph of b — » (3(b) (see l |2.28b ). 
It attains its maximum at 6*. (c) The value function v(x) with 6* = 0.736246 and (3* — 1.16523. (d) The derivative v'(x): It 
is v' (x) on < x < b* and v'(x) — 1 on b* < x (lower line). The derivative v' (x) on b* < x is also shown to illustrate that 

vS(b') = 0. 



Example 2.2. Dividend payout with a square root process: We solve the problem defined in ( 12.52b when the 
cash flow of the company is modeled by the following square root process: 

dX? = (l- 2pX°)dt + 2<Jx?dWt, X$ = x > 0. (2.56) 
The solutions of (.4 — a)v(x) = are 

iP(x) = x-^cxp (^) M_ % +h -i(px), <p(x) = x-^exp ) W_ « +i ,^(px), (2.57) 
in which W_a_±\ _\ and M_o L ,i _i are Whittaker functions. (See Appendix 1.26 of Borodin and Salminen 

2p~ l ~4'4 2p~ t "4'4 
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|2 1 as well as Chapter 2.1.11.) The Whittaker functions are defined as 



W_^ +it _i f -j J = W- x yfcD_ a/p {x), x > 0, 

m ( x \ r((i + a /p)/2) (2 ' 58) 

M_^ + i _i I — 1 = Vx{D_ a/p {-x) - D_ a/p {x)), x>0, 

in which T stands for the Gamma function T(x) = J °° u x ~ 1 e~ u du and D v {-) is the parabolic cylinder function, 
which is defined as 



D4x)±2"/ 2 e-* 2 /*H v UU, 



x G 



in terms of the Hermite polynomial, H u , of order v, whose integral representation is given by 



H ^ z ) = TT—^ I e- t ^ 2tz t-"- 1 dt, Re(i/) < 0. (2.59) 



r(-iz) 

See e.g. Lebedev |8|. The Hermite polynomials satisfy H' u (z) = 2vH v -\(z), z G 
Verification of the Conditions in Proposition l2.lt 

(i) Note that 



= ^ = ^ (2.60) 

tp(x) <p{x) 



and the differentiability of R(y; b) comes from that of F(-) and i^(-). 
(ii) Since 

d K(x,b) (p(x) — (x — b)tp'(x) 



> (2.61) 



dx ip(x) tp(x) 2 
for x > b, using ( 12.501 ), it can be seen that R(y; b) is increasing on y G {F(b), oo) to oo. 

On the other hand, (A — a)(x — b) = p(x) for every x > 0, in which = (1 — 2px) — a(x — b). This 
linear function p(x) has one positive root at say, k. Then R(y; •) is convex on y G [F(0), and concave on 

ye (F(fe),oo). 

The facts that 1 / (p(F^ 1 (y)) is increasing to oo and concave on [F(Q), oo) can be similarly shown (by replacing 
K(x, b) in ( 12.601 1 with unity). 

(iii) We need to verify that (I2.54l i and (12.55b hold. In fact, we will see that when a > 0, the unique solution of 
( 12.54b or the optimal reflection level satisfies b* G (0, l/(2p)). This result is very intuitive, since x = \/{2p) is 
the mean-reversion level of X. 

The functions ip(-) and ip(-) both solve the differential equation 

(1 - 2px)w'{x) + 2xfw"{x) - aw{x) =0, x E (0, oo). (2.62) 
Also, we know from their representation in ( 12.21 ) that 

tp(x) > 0, V'O) > 0; <p(x) > 0, <p'(x) < 0, a;e(0,oo). (2.63) 
Evaluating ( 12.62b at x = 1/(2/)) for w — tjj and w = (p,we obtain 
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from which it follows that, for a > 0, 



<p{£) ^ 2p 



= F I i- ) > F(0) > 0, (2.65) 



where the first inequality follows from the fact that F defined in d2.3b is increasing. If a — 0, then i/>"(l/(2p)) = 
p"{l/{2p)) = 0. 

First, we will show that (|2.54| i has a unique solution in (1, l/(2p)], and show that this solution indeed satisfies 
( |2.55| i. Next, we will show that the same equation does not have a solution in (l/(2p), oo). To establish our first 
goal, let us collect some information on the behavior of the functions ip(-) and ijj(-) over this interval. From ( 12.62b 
with / = tp, we see that when 



<p"(x)>0, arefo,i- 
since <p'(x) < and <p(x) > over the same interval. Differentiating ( 12.3b we obtain 



(2.66) 



{2p + a)w'(x)-(3-2px)w"(x)=2xw"'(x), xe(0,oo), (2.67) 
for w — if} or w — (p. Using ( 12.67b it can be seen that 

<p'"(x)<0, xe (o,j- , (2.68) 

using the fact that <p'(x) < and p"(x) > on the same interval. 
After simplifying the expression for ip(-) in ( 12.56b . we write 

ip(x) = H_ a / p {-«Jpx) - H_ a/p (^fpx). (2.69) 
The second derivative ofip(-), then can be computed as 

1>"(x) = -^=x~ 3/2 (J?_ q/i0 _!(-Vp5) + H_ a/p _ 1 {^px)) + ~ + lj x- 1 (H_ a/p _ 2 {-^fpx~) + H_ a/p _ 2 (^px)) , 

(2.70) 

from which it follows that 

lim ip"(x) = -oo. (2.71) 

With the help of ( 12.67b with w — ip, observe that 

if x € (0, l/(2p)), then ip"'(x) > 0, if ip"(x) < (2.72) 

since ip'(x) > 0. It follows from ( |2.65b and (12. 66b that ip"(l/(2p)) > 0. Now, this fact together with ( 12.711 ) imply 
that 

ip"(z) < for x £ (0,:co], where x G M), -^J . (2.73) 
And it also follows from ( 12.72b that 

ip"(x) > 0, i£ [ x 0) -^- j . (2.74) 



2p, 

At this point, we can state that there exists a solution, b* £ (xq, l/(2p)) to ( 12.54b as a result of (12.65b . ( 12.66b . 
(12.73b and the intermediate value theorem. 

Let us prove that at b*, ip"'(b*) > 0. If ip"'(b*) < 0, then there would exist a point xq € (xq, b*) such that 

^"'(xo)=0, V (4) (^o)<0, (2.75) 
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in which tp^' stands for the fourth derivative of ip- Differentiating ( 12.67b we write 

(4/? + a)w"(x) — (5 - 2px)w"'{x) = 2xw i4) (x), x £ (0,oo). (2.76) 

Evaluating the left-hand-side of ( 12.76b (when w = iff) at xq we obtain a positive quantity using (12.74| > and the 
equality in ( 12.75b , whereas the right-hand-side of ( 12.75b due to the inequality in ( 12.75b , which yields a contradiction. 
Since tp"'(b*) > 0, and <p"'(b*) < by (|2~68T >. b* satisfies (12351 . 

Let us show that 6* is the only solution to (12.54b in (0, 1 / (2p)). Assume there exists another solution to (12.54b in 
(0, 1/(2/9)), then necessarily there would be at least one more solution to (12.54b in (0, l/(2p)) (This follows from 
(12. 65b . ( 12.66b . ( 12.68b . and (12.73b ). Let us denote the largest three of all of the solutions by x\ < x 2 < x%. It can be 
easily under this assumption 

ip"{x) >ip"(x), xe(xi,x 2 ), and ^"'(x 2 ) < 0. (2.77) 

But this contradicts the fact we have proved above: since x 2 is a solution to ( 12.54b . ip'"(x 2 ) > 0. 

It remains to show that ( |2.54b does not have a solution in [ 1 / ( 2p) , oo ) . It is clear from ( 12. 65b that a; = l/(2p) is 
not a solution of J2.54b . Let us assume that for x > l/(2p), ip"(x) = F(0)<p"(x). Then, 

- (1 - 2px)ip'{x) + aip(x) = -F(0)(1 - 2px)ip'(x) + F(0)atp{x), (2.78) 

which implies that 

„ |ffrF|1))H1 - W (M!«). (2J9) 

Note that the left-hand-side of ( |2.79b is non-negative because F is increasing. On the other hand the right-hand-side 
of (|2.79b is negative. This yields a contradiction. 

Verification of the Conditions in Proposition [273} The only non-trivial condition to check is whether v" (x) < 
for x £ (0, oo). It is clear from our analysis above that ip"(x) — F(0)tp"(x) < on x £ (0, b*). The concavity of 
v follows from Remarkl2~TT-c. 



We can determine (3* from (12.261 ) and write down the value function as 

v(x) = 



Vo (x) = p*{i>{x) - F(0)tp(x)), 0<x<b* 
v a (b*)+x-b*, b*<x. 



in which i/j(x) and ip(x) are given by (12.57b with ( 12.58b . Figure |2] illustrates the function b — > (3(b), the value 
function, v, and its derivatives for a special choice of parameters. 



3 Appendix 

Lemma 3.1. Let us assume that assumption ( I2.ffl ) holds. Then for any stopping time r of the filtration (J"t)t>o 



e- as f(X°)ds 



= g(x)-E x [e- a Tg(X° T )], (3.1) 



in which g is defined in ( 12. 91 ). 

Proof. The proof immediately follows from the strong Markov property of the process X°. □ 
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v(x) 



V (x) 
3 

2 . 5 



0.2 0.4 0.6 



1 1.2 1.4 



(c) 



1.5 

1.25 
1 

0.75- 
0.5 
0.25 



.2 0.4 0.6 0. 

(b) 



1 1.2 1.4 



v" (x) 



. 2 -9'. 4 0.6 0.8 1 1.2 1.4 



(d) 



Figure 2: The dividend payout problem with a square root process with parameters (p, a) = (1,0.2): (a) The graph of 
b -> 13(b) (see l T2~2"8l ). It attains its maximum at 6*. (b) The value function v(x). b* = 0.4370 and f3* = 2.2826. (c) The 
derivative v'(x): It is v' (x) on < x < b* and v'(x) = 1 on b* < x. The derivative v' (x) on b* < x is also shown to 
illustrate that v'd(b*) = 0. 



Lemma 3.2. For any pair (l,r) £ (c, d) 2 , let us define 



v r (x) ^E*[ e -*M {TV<Ti} ], anrf «,(!) ^E-[e- QT "l {r , <Ti . } ], a; € [/, 



Then 



ip(l)cp(r) - if>(r)cp(l) 



ip(l)tp(r) - ip(r)ip(l) 



(3.2) 



Ml) = f&M, W t>iW= ^-!"!?S-| V !Sn ) , *ep,r]- (3-3) 



Proof. Both x — > w r (x) and x — * (a;), x £ (c, d) are solutions to (A—a)u = with boundary conditions vi (I) = 
v r (r) = 1 and vi(r) = v r (l) = 0. Therefore, we can write them as linear combinations of the homogeneous 
solutions of (.4 — a)u = 0, and we get (13.3b . □ 
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